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PREFACE 


The work reported herein was authorized under Contract 
NAS1-14416. Preliminary, closely-related work was performed 
under Contract NASl-13734. Both studies were conducted under 
the direction of Patrick Gainer, Simulation and Human Factors 
Branch, Langley Research Center. 

This study was performed at Decision Science, Inc., San 
Diego, with Michael L. Mout acting as principal investigator. 
George H. Burgin and Michael J. Walsh contributed to the 
computational implementation of the Kalman filter. 

The original idea of evaluating displays by sensitivity 
analysis was conceived by Patrick Gainer and is documented 
in the Langl ey'^ Research Center working paper No. 1131, "A 
Method of Anal^t^ and Evaluating Visual Displays." 
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USE OF SENSITIVITY ANALYSIS TO PREDICT PILOT 


PERFORMANCE AS A FUNCTION OF DIFFERENT DISPLAYS 

By Michael L. Mout, George H. Burgin, and Michael J. Walsh 

Decision Science, Inc. 

SUMMARY 

This report describes a novel technique for computer simu- 
lation and evaluation of visual displays as they relate to human 
scanning behavior and control performance. A computer program 
has been written for a general situation, but the usage in this 
report is specifically for pilot performance in aircraft 
control . 

The computer program sets up some general flight situation 
with a given set of displays. A look-point controller simulates 
visual scanning of these displays,. It does this by picking 
a look point at each time step that minimizes some estimation 
error criterion. The result of each run is a covariance matrix 
of state variable estimation for each point in time during the 
simulation. This covariance matrix gives two types of measures. 
One is the variance, or standard deviation, measure for each 
state variable. This measure indicates the accuracy with which 
that state variable can be estimated with the display setup 
being considered and the present look point. Other values 
derived from the covariance matrix are the correlations between 
state variables. These correlations are a measure of the 
complexity of the display setup with respect to the present 
look point. 

Several runs were made simulating an Instrument Landing 
System (ILS) approach. Runs with user-controlled (fixed) look 
points generated error measures and • compl exi ty measures that 



seem to be intuitively correct. Runs with the look-point 
controller resulted in scanning patterns similar to human 
behavior. These patterns were noted for both automatic and 
manual ILS approaches. 


INTRODUCTION 

The derivation of visual information about an aircraft 
state from a display or set of displays can be a complex 
process. Figure 1 is a simplified flow chart of this process. 
The human observer must know or be able to approximate how the 
display responds to changes in the various state variables. He 
needs some measure of how accurately he is able to estimate the 
changes in the displays themselves. He must know the amount of 
inherent noise in either the state variables and/or the display 
system. He must also know how the state and control variables 
are related in time. With this information, the pilot/observer 
has the capability of estimating the changes in the aircraft's 
state variables and the accuracy of that estimation. He uses 
this information to derive control inputs which allow him to 
extrapolate to the next state. The next state estimate is used 
to control the display look point for the next time step.* 

The purpose of this investigation was to develop a digital 
computer program for dynamic display evaluation and scanning 
simulation. This program was to be used for evaluation of 
possible pilot performance on conceptually designed display 
setups prior to actual hardware construction of these displays. 
This program is based on a static display evaluation technique 
(Reference 1) derived by Patrick Gainer. This static technique 

*The simulation in this report is done in discrete time 
steps (such as, 1/16 second or 1/8 second). For the sake of 
brevity, any future references to "time" in this report will 
imply "time step." 
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has been incorporated into a computer program using Kalman 
filter techniques to generate dynamic display/flight motion 
and a visual scanning simulation. 

The scanning simulation is accomplished by a look-point 
controller which minimizes some user-defined error criterion. 
This controller allows the user to define weights for the 
various state variables then select look points by minimizng 
either the weighted mini-max estimation error or the weighted 
covariance matrix trace (sum of the weighted variances). This 
minimization is either through an iteration process for a local 
minimum or over a small set of predetermined look points. 

This program is presently set up to simulate seven 
standard cockpit i ns t rumen ts under ILS conditions. The program 
has been written to allow for any general display setup and can 
be modified for a variety of flight conditions and display/ 
state relationships. 

Altimeter: 

Command Bars: 

Control Vector: 

Correl ati on : 


Display Segments: 
Display Weights: 


GLOSSARY 

Altitude indicator display. 

(Vertical and Horizontal) Displays 
showing the best control commands 
to retain the glide slope path. 

Values for control of the future state 
vector values. 

Measure (ranges from -1 to +1) of how 
two variables change with respect to 
one another. 

Arbitrary segments into which each 
display is divided. 

Overall weights for each display 
indicating general degradation of visual 


3 



Eight Ball: 

G1 i desl ope : 

Glideslope Indicator 
(GSI ) : 

Influence Matrix: 

Look Point 

Look-Point 
Control ler; 

Look-Poi nt 
Control ler Weights: 


Segment Weights: 

Variance of 
Estimati on : 

Vertical Speed 
Indicator (VSI): 


acuity of that display. Can be speci- 
fied for the total simulation and for 
each new read-in look point. 

Artificial horizon display showing roll, 
pitch, and sometimes yaw. 

Landing approach descent path which will 
result in ideal landing conditions. 

Display showing the vertical angular 
distance above or below the glideslope. 

Matrix giving the influence of changes 
in the state vector to changes in the 
display segments. 

Location in display set where the 
observer looks for one time step. 

Computer algorithm that controls the 
look point for the next time step. 

Weights for each state variable used by 
the look-point controller algorithm in 
the minimization criterion. These 
weights are related to the relative size 
of the state variable standard deviations 
and their relative importance to the 
pi 1 ot/observer . 

Values for each segment indicating the 
relative amount of information in that 
segment. 

A measure of the amount of expected 
error in estimating the value of a 
variable. 

Display showing the rate of change 
of altitude. 



Visual Acuity 
(position or 


A measure of the accuracy with which 
rate): an observer can perceive change of 

position location or change of rate of 
movement of a display segment. A 
decrease in the acuity measure indicates 
a decrease in the accuracy of measure- 
ment, The inverse of the acuity measure 
is the standard deviation of the error 
of estimation. 
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SYMBOLS 




ac(x) 


cb 


h’ 


cb 


V 


Cfj 




fa{ j , k, x) 
fb(j, k, l\ x) 




Matrix relating present time, i, state 
variables to next time, i+1, state 
variabl es . 

Acuity measure for a polar angle x. 

Matrix relating present time, i, 
control variables to next time, i+1, 
state variables. 

Horizontal (cb^) and vertical (cb^) 
control commands displayed by the 
command bars . 

Optimization criterion for the look- 
point controller algroithm. 

Matrix relating present time, i, 
system (or turbulence) noise to future 
time, i+1, state variables. 

Display/state functions relating the 
state vector ^ to the location (fa = 
horizontal, fb = vertical) of segment 
j , k in display 1. 

Identity matrix. 

Gain matrix from Kalman Filter. 

Measure of the weight given to the 
observations and to the observation 
covariance matrix, in estimating 
the present and future state vectors. 
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niQ 
n V 


tr(2:) 


W 






|i 


^i+1 |i 


‘ ^ ® y ^ ■ 9 


x^» y^,9 2^ 
“jk£’ “jk£ 


Expected value of the initial 
state, X. 

Number of state variables. 

Vector of observations at time i; 
two observations per segment, one 
for horizontal displacement, and 
one for vertical displacement. 

Trace of matrix 2 , sum of diagonal 
values. 

Control vector at i^ time step. 

Diagonal matrix of controller weights' 
with state variable weights on 
diagonal . 

State vector at time i. For ILS 
simulations, = (v, 0 , <i> , x^, y^, 

2^, Zr’ '^^h' 

Estimate of state vector at time i 
based on the observations at times i, 
i -1 , i-2 . . . , 1 , and 0. 

Estimate of the state vector at time 
i+1 based on observation i, i-1, i-2, 

. . ., 1, and 0. 

Runway fixed coordinates 
' x^ = range to end of runway 
y^ = distance off-line of the runway 
= altitude above runway 

Rate of change of x^, y^, z^ 

Longitudinal and latitudinal coor-. 
dinates of segment j, k in display £. 
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state vector noise (turbulence) at 
time i. 

r^. Covariance matrix of state vector 

noi se , time i . 


8f a[fb] 
3X_ 


( j 


x) 


X 



X 




( j , k, 1) 


^i 


Partial derivative of horizontal 

[vertical = fb] display state function 

t h 

with respect to the m^ state variable, 
m = 1 , nv. 

Longitudinal and latitudinal coor- 
dinates of the look angle at time i. 

Polar angle from look point at time i 
to center of segment j, k, display t. 

Observation error time step i. 

Covariance matrix of observation error 
at time i . 


1 


i i 


^i + 1 I i 


'V , e, $ 


Covariance matrix of the error of the 
state vector estimation | ^ • 

Covariance matrix of the error in 

-i+1 |i* 

Influence matrix at time, i. Consists 
of partial derivations of fa and fb 
with respect to x -j • Relates display 
segment changes to changes in the 
state variables, x ^ . 

Euler angles, yaw, pitch, and roll 

BACKGROUND 


The original idea for a mathematical algorithm for 
evaluation of a visual display was put forth in 1973 by 
Patrick Gainer in Langley Working Paper LWP1131. In 1974 
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a contract was awarded by Langley Research Center (LRC) to 
Decision Science, Inc. (DSI) to design a computer program to 
implement this static display evaluation technique 
(Reference 1 contains a description of this work). 

This computer program was valid for displays which 
did not move and for fixed look points. A simple experiment 
was conducted at the DSI facility that verified the results 
of the program. Several problems were noted that made it 
difficult to apply this initial program to any real-life 
display situations. The basic problem was the inability to 
incorporate movement of the displays into the program. 

The static technique does not include additional infor- 
mation that is available to an aircraft pilot. The location 
of the display segments, the display/state relationship, and 
the pilot's look point are all the information that is accounted 
for in the static program; see the area in Figure 1 enclosed 
in dotted lines. In real life, the pilot has additional 
knowledge of the time history of the aircraft movement and the 
effect of the present state and the present control inputs 
on the future aircraft state. Also, the pilot has some know- 
ledge of the amount of noise (turbulence) he can expect in 
the state variables. 

A second contract was awarded to DSI in 1975 to expand 
the original static technique and program to include dynamic 
display evaluation and to also include a look-point controller 
algorithm which could, in a sense, simulate the pilot's visual 
scanning behavior. 

The Kalman Filter provided much promise for the dynamic 
extension of the static technique. Several look-point controllers 
were to be analyzed as possible candidates for simulating human 
scanning. 
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static Model 



Summary . - The static model is based on two assumptions. 

The first assumption is that a display can be divided into 
arbitrarily small segments as in Figure 2. The second assump- 
tion is that for small changes in the state variables these 
segments can be Considered to have only horizontal and vertical 
change (no rotatioh). 

For example, in Figure 2 the display is shown in a zero posi 
tion in the top figure with the initial segmentation. The middle 
figure shows a pitch down change. This causes a positive change 
in each segment's latitudinal location (a 3 > 0). The bottom 
figure shows a negative pitch andposTt.iva roll. This causes 
changes- in each segment's location. The segment shown has a posi 
tive change in longitude (Aa > 0) and a negative change in 
1 ati tude ( A6 < 0) . 

Based on the above assumptions an equation can be derived 
for estimating the state vector from the observation of the 
horizontal and vertical displacement of the display segments. 

The accuracy of this estimation is dependent on the accuracy of 
observation of these displacements. This accuracy is assumed to 
be dependent on the polar angle between each segment's center 
point and the observer's fixation point as in the top figure, 
Figure 2. This angle determines the acuity of that center point, 
and the inverse of the acuity squared is the variance of this 
observati on . 

For example, in Figure 2 the top figure shows a fixation 
point located at 1 ongi tude and latitude angle from the 
display center. Each segment has an angle associated with this 
look point. Segment number 4 has an angle from the look point 
of x(4), segment 2 has an angle of x(2). Each segment's 
angle to the look point is used to determine an acuity 


10 



value (see Figure 3 for a sample acuity function). In this 
case, the acuity for segment 4, ac[x(4)], will be larger than 
ac[x(2)]. This means that less error will be experienced in 
estimating change in position of segment 4 than for change in 
segment 2. 


The variances of the display segment observations are 
used in the derivation of the covariance matrix of estimation 
of the state vector. This covariance matrix is used to 
evaluate various look points within a display and compare the 
relative worth of various displays or display setups. 


For example, in the top figure. Figure 2, fixation point 
two is better than point one because the associated estimation 
covariance matrix has smaller values both oh and off the 
diagonal. This means that with the second fixation point 
less state variable (pitch and roll) estimation error will 
be incurred,and there will be less confusion between changes 
of pitch and roll as compared to fixation point one. 

Mathematical Model .- Let the state vector be represented 

by 2 ^, x' = (x-|, X 2 » The display is divided into 

m horizontal segments and n vertical segments, making n x m 

total segments with a.., 6^ ^ being the longitudinal and 

t h 

latitudinal angles of the i, j segment. Let 


fa.j = 6,^; x) 

fbij = X) 


be the functions that relate values of the state vector to 

values of a., and 6.., respecti vely . 

I j J 


How the influence matrix, so called because it determines 
how the state variables influence the display variables, can 
be defined as (see following page) 
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ata„ 

»fa„ 

ax-i ‘ 

3 X 2 

3fb,,_ 

afb,, 

3x-| 

3 X 2 

nm 

3f a 

nm 

3X^ ’ 

3 x 2 

nm 

3f b 

nm 

3X.| ’ 

3 X 2 


3f 


af b 


n 


ax 


n V 


af a 


nm 




So if the observation vector, is defined as the 
changes of each segment in horizontal and vertical 
then 


vector of 
di recti on , 


0 = T . X. 

The covariance matrix of the estimates of these observations, 
cov (£) , is a diagonal matrix with the inverse of the square 
of each segment's acuity on the diagonal. It can be shown 
(Reference 1 ) that the estimate of the state variable, x, is 


^ = [ T cov(£)'^ T ] T ' cov(6)"^ £ 

It follows that the covariance of this estimate reduces to 

. -1 

cov(^) = [ T' COv(6), T ] 

This is basically the technique the static computer 
program implements. A more detailed discussion of these equations 
can be found in Reference 1. 


Computer Program for Static Display Evaluation .- The 
computer program for static display evaluation was written in 
as general a form as possible. This allowed the user to create 
a wide variety of display setups with many display/state 
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variable functions. Various user specified input parameters 
were used to allow the user to establish the number of state 
variables, number of displays, size and segmentation of each 
display, various input and printout options, a variety of 
display/state functions, and position of rate of movement for 
the acuity functions. The program was written to allow the 
user to modify or add FORTRAN subroutines for new display/ 
state functions or different acuity functions. 

The program was exercised on a wide variety of displays 
and look points. The results of these runs agreed with intu- 
ition as regards the values in the covariance matrices. 

The program was modified to allow weighting of different 
displays to indicate sequential look points, but this was not 
a satisfactory solution for the dynamic display situation. 

Results of a Simple Experiment and the Static Display 
Technique . -A simple experiment was devised and conducted at 
the DSI facility. This experiment was designed to verify the 
Static Display Evaluation technique by comparing the theo- 
retical covariance matrices calculated by the program with 
the actual experimental sample covariance matrix. 

The experiment was designed to generate a series of state 
variable estimations for each of several look points. The 
observer was. instructed to fixate on a certain spot, then line 
up a movable cross hairs with a fixed cross hairs. The 
accuracy of the final location of the movable cross hairs 
was used to calculate a state variable estimate of yaw, 
pitch, and roll. 

The same look points and a display model were read into 
the computer program. The total experiment is reported in 
Reference 1. 
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Summary of the Results .- The theoretical covariance 
matrices were calculated for two different weighting schemes 
on all four experimental conditions. The first weighting, 
scheme was a gross approximation of the actual display and 
resulted in theoretical variances which were much lower than 
the sample variances. Thesecond weighting scheme was an 
attempt to more precisely reflect the actual display. This 
scheme resulted in much larger theoretical variance values. 

The values were, in most cases , . not significantly different 
from the sample variances. Under both weighting schemes 
most of the sample correlations were not significantly 
different from the theoretical. 

Experimental Conclusion .- The primary conclusion to be 
drawn from these results is that the basic computer model of 
the display can drastically effect the analysis. When using 
the proper setup, the algorithm seems to be a valid model 
of human performance. There are many consistencies noted 
between the sample covariance matrices and the theoretical 
matrices. The presence of the consistencies gives a strong 
indication that further experimental data would be valuable 
for a more in-depth verification of this model. 

Kalman Fi 1 ter 

The Kalman Filter is based on a process that has linearly, 
time-related state and control variables, and system noise 
or turbulence, with known probability distribution. These 
state variables are linearly related to observation variables, 
which have estimation errors with known probability distribution. 

A Kalman Filter is a computational algorithm to provide 
estimates about a state vector at a time t\j , given an estimate 
of the state vector at time t^_^ (and all previous times, 
ti-^ . • . tQ) and an observation vector at time t^.. The 
Kalman Filter was originally described by Kalman in References 
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2 and 3; a concise summary of the technique and its computa- 
tional aspects may be found in Reference 4. 

If we denote the true state vector at time t^ with 
X. and its estimate by | ^ » the Kalman Filter provides a 
recursive algorithm by which | ^ can be determined so that 

E^^iii|i “ -i ^ ^-^i I i " -i ^ ^ minimized. Therefore, | ^ is 

a best estimate in the least squares sense. 


The Kalman Fi 1 ter obtai ns x ^ | . in two steps. In a 
first step, it calculates a predicted estimate of the state 
vector at time t^ from the estimate of the state 

vector at the preceding time and its covariance 

matrix tj_i|^_iand the (given) state transition matrix and 
control vector. For the calculation of these quantities, the 
observations at time t^- are not yet used. 


In an intermediate step, a weighting or gain matrix 
is calculated. This gain matrix is a function of the system 
under observati on.and for its calculation the covariance matrix 
of the predicted estimate of the state vector as well as those 
transformations describing the system under observation are 
used. 


The second step of the Kalman filtering process now 
takes into account the observations made at time t^ . First, 
an observation vector (£^- ) which would correspond to the 
predicted estimate of the state vector, is calculated. The 
actual observations made at time t^- (o^- ) will, in general, 
be different from these predicted observations and the 
difference (£. - ) is formed. The f i n a 1 estimate of the 

state vector is then a linear combination of the predicted 
estimate and the weighted (by the gain matrix) difference 
(£i ■ £i ) • covariance matrix of the final estimate may 

be obtained at the same time as the gain matrix is calculated 
because it is a function of the same variables. 
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For example. Figure 4 shows a simple process to which Kalman 
Filter techniques may be applied. In this example a dot has 
controlled movement in a plane. At time zero, the dot is near 
(1, 1). A control value of (-1, -1) is input at times 0 and 1. 
This makes the dot move close to (0, 0) at time 1 and (-1, -1) at 
time 2. The control at time 2 is (-1, 0). This moves the dot to 
approximately (-2, -1) at time 3. The noise in this movement 
perturbs the actual location as seen in the figure. 

The observation of this dot's movement is on a linear scale 
that shows the sum of the coordinates of the dot at each time 
step along with nonzero random noise. At time zero, the obser- 
vation is at +2.55. This is the sum of the zeroth coordinates 
(1.2, .85) plus a random noise value of .5. 

At time 1, the observation is-.05 = .25 - .05 [-.25 (random 
noise)]. The random noise at times 2 and 3 is .25 and -.1 giving 
observation values of -1.57 and -3.10, respectively. 

Here, the state, control, and noise variables (x, y, u , u , 

* w 

and Yy , respectively) are related linearly in time by 

N+l = >'( * “x, * l-x, 

' J'i * * ’'y, 

Also, the observation variable (o) is linearly related to 
the state variables and the random noise (c) by 

0, . X. t y, t E. 

Mathematical Model .- The process to which Kalman Filter 
techniques apply has a general formulation. Specifically, if we 
let be the state vector at time step i, then 




* Olii 
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where 


2io "" nio ^0^0 

= Control Vector 

, and D. = Matrices relating the present state and 

the control and noise vectors to the next 
state . 


and 


nif, = Expected value of _Xr 


= Covariance matrix of the state vector noise, 
Also, if is the observation vector, then 


0 • = T . , X . + £ . 
—1 1 ’ -1 


where 


= Matrix relating state vector, x ^ , to the observation. 


and 


Oi- 


= Covariance matrix of the observation error, £^ 


In the example. Figure 4, 

X' . = (x,. y,); u'( = (u . u ) 


and 


A. = B. = D. = I 

X, _ foi5 ol 
M 0 .015| 


T. = (1, 1) 


Of. 


m-Q = (1, 1) 


Hi = .4. 
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Many analytical results have been derived for the Kalman 
Filter. Specifically, least squares estimates for the present 
state vector, | ^- and the next state vector, have 

been formulated. Also, the corresponding covariance matrices 
(^i|-j+]« ^i|i^ of these estimates are avai 1 able al ong wi th 
the gain matrix, K^. . These are as follows: 


ii M ' * ''f [if - ’’i N |i-J • 

Also, the gain matrix, , is found as 

’■'1 [’■f ^111-1 '•51] . 

Finally, 


E,|, = [I - K, . T,] 

The initial conditions are given as 

^0 ” — 0 ” ^^—0^ expected value of 


Zo|o = Initial given covariance matrix. 

(See Reference 2 for the derivation of these estimates.) 
As shown in Appendix A,K^. can be reduced further to 

’'1 
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wi th 


E 


1 1 



t: 



The latter form of is more desirable in this appli- 
cation as it requires the inversion of a much smaller dimensioned 
matrix than the initial form. 


Referring to the example in Figure 4 with ^:q|q given 
as 

^ 0(0 

and 





/1.015 0 \ 

V 0 1.015;* 


It should be noted that in this example the observation 
space is one dimensional and the state space is two dimensional. 
This does not invalidate this process for the Kalman Filter 
technique since there is assumed knowledge of Eq and m^. With 
this process the covariance matrix E^j^. will converge to a 
singular matrix as i ^ 
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Now for time 1 


G) (-^r’ (' ’)] 


179852 0 ' 

\ . /2.5 2 .^ 

-1 

K 0 .9852 

) ^ I2.5 2.5/ 


/3.49 2.5 \ 

/.591 

-.4234'! 

V.s 3.49/ 

t .4234 

.591 / 

591 -.4234"^] 

4234 .591 j 1 

= t 

41^ 

419/ 


and 




(: J 1 | -[°=- <’ ')@1 

/’-.021\ _ /-.021\ 
^.021/ ■ \-.02iy • 


Following this process for the remaining time steps 


time = 2 


II 

CSJ 

( .606 
\-.42 34 

-2|1 " 

f-1 .021^ 
V- 1 . 021 / 

^2|2 " 

( . 5624 
\-.46 70 

^2 = 

/.238^ 

^2385/ 

^2|2 " 

/-.908) 

\-. 908 ) 

time 3 


^3|2 “ 

/ . 5774 
V 4670 


-.4234'\ 
.606 / 


-.4670\ 

.5624/ 


-.4670\ 

.5774/ 
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^ ( .2391 -.2154\ 

^3|3 ■ 1-.2154 .2391/ 

A0592'\ ; _ /-1. 925^ 

*^3 ■ V.059^ -3|3 " \-.92£/ 

It can be seen in this example that the covariance 
matrix of the present estimate is decreasing as i 

increases and that it is tending to converge to some matrix 
that is determined by the matrices r, T, and E. Also, the 
covariance matrix of the prediction is larger 

than by a constant value of .015 on the diagonal. 

The corresponding state estimates are within the bounds 
established by the covariance matrices. 

Kalman Filter and the Static Model .- The relation between 
the Kalman Filter and the static model is in the observation 
equation. In the previously described equations the same 
variable names, matrix names, and notation were used in the 
Kalman Filter observation equation as in the static model. 

This makes the final step that brings the static model together 
with the dynamic Kalman Filter method more clear. To make 
this step, note that the cov (£) in the static discussion is 
the matrix E^ in the Kalman Filter. Thus, the observation 
error becomes the error due to the lack of the acuity for the 
look point at the time step i. In other words, the matrix s^. 
is a diagonal matrix with dimension equal to twice the number 
of display segments. If we let 


ac(x) = acuity of a segment that has a polar angle of 
X degrees from the look point. 


Also let 

k, 1 ) = angle between the i look point and 
segment j, k in display 1 . 
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Now , i f 


e^.(j, k, 1) = {ac[x. (j, k, £)]}"^ 


then e.(j, k, £) is the observation error variance of the 
j, k segment, in display t at time i. Since there are two 
observations associated with each segment (that is, vertical 
displacement and horizontal displacement), then the observation 
error covariance matrix at time i has the following form. 


( 1 , 1 , 1 ) 0 


0 

0 

0 

0 


e. (1, 1, 1) 0 


e. (1. 2, 1) 0 


0 

0 


> 


‘e. (Op, mp, p) 0 
0 e. (np, mp, p)J^ 


Note that each e^(j, k, z) occurs twice. This is due to 
the assumption that the variation in horizontal estimation 
error and vertical estimation error is the same. 


Referring back to the example in Figure 4, the obser- 
vations could be considered to be the observer's visual 
estimates of the location of the points on the bottom scale. 

The actual locations would be (Oq = 2.05, o-j = .20, 

= -1.32, 0^ = -3.0). The error , i = 0, 1, 2, 3 
would be due to the lack of acuity at look points 0, 1, 2, 
and 3. Note here the H matrix has only one value since the 
display segment only moves horizontally. Thus, = e^.(l, 1, 1) 

= {ac(x)> for i = 0, 1, 2, 3 since the angle, x = x^ from 
the look point to the segment center is the same for each 
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time step. In more complex displays this matrix, 5^, could 
change drastically with each time step depending upon the 
amount of change in the look point during each time step. 

The remaining adaptations of the Kalman Filter for dynamic 
display evaluation are in the state vector equations. Here, 
the control vector, its relationship to the next state, the 
size of the state vector noise, and the relation between 
present and future states can be adapted to approximate the 
flight conditions or vehicle conditions under consideration. 

For example, the sample runs shown later in this report 
simulate a landing descent with nine state variables, 

x' = (f, e, $, x^, y^, z^, x^, y^, 

with no significant movement in yaw, h'*, roll, distance off 
course, y^; or y^. Here. 

= (0°, -2.5°, 0°', -10,770 meters, 0 m., 460 m. , 85 m. 
per second, 0, -3.7 m. per second); 

that is, the initial conditions are -2.5° pitch down from 
level flight (2.5° glide slope), 10,770 meters from the end of 
the runway, altitude of 460 meters, speed 85 meters per second 
(165 knots), and descent rate 230 meters per minute. 
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For 1/16 second time steps, the x^, y^, and column and x^, y^, 

and z row values would be 1/16 instead of 1/8. 
r 

The control vector for this simulation run corrects e, z^, 
and x^. The control function corrects e to -2.5°, adjusts z^ to 
be on the 2.5° glide slope (see Appendix B), and keeps x^ at 85 
meters per second (165 knots). 

— ~ ^control ’ ^control’ ^control 


so that the control matrix, B, has the form 


'f 

0 

$ 

X. 


1 

0 

0 

t 

0 

0 




0 

0 
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0 

0 

1 

0 

0 
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0 
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O' 

0 

1 

0 
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For this example, the noise vector 
state variable, and the D matrix is 
for 1/8 second time step 


contains values for each 
the identity matrix. Also, 




O0 = 
OXp = 

a, = 
fr 

“Xr ■ 


’zr 


so that 
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Look-Point Controller 


The final step in developing the dynamic display evaluation 
was to incorporate a method or methods which could be combined 
with the Kalman Filter to control the look point for each time 
step. These look-point controllers would minimize some error 
criterion through the use of the statistics generated from the 
Kalman Filter. The use of this controller would result in 
performance measures over time that could possibly’be used 
as a minimum base line ("best") for human pilot performance. 

In other words, if the acuity function, system noise, and 
all other parameters correctly reflect the real-life or pilot- 
simulator situation, then the perfect human pilot should be 
able to achieve performance comparable to that predicted by 
the program. 

Mathematical Models .- Three look-point controllers have 
been incorporated into the system: 

1 ) Local minimum-weighted trace 

This controller calculates the covariance matrix for the 
next time step at the present look point. This is called the 
zeroth candidate look point for time i+1. The covariance 
matrix for this look point is 

5,0 _rj.-l . -p' --1 T 1^ 

^i+l|i + l “ ‘■^i + l|i i + 1 “i+1 i + l-* 

The trace of this matrix is taken as the zeroth criterion 
at time i 

Now four look points are chosen equidistant from the 
present look point (these will usually be the centers of four 
adjacent display segments). The covariance matrix is calculated 
for each of these look points along with the trace. This gives 
cr^^^ , cr?^^ , cr^^^, and cr^^-|. If any of these values are 
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smaller than cr9^^ , then cr^^l is set equal to that 
value, and the associated look point is taken as a new zeroth 
candidate look point for time i+1. This process continues 
until a candidate look point is found such that 

1 + i for j = 1, 2, 3, 4. 

This look point satisfies the local minimum on tr ( ^1 |\. ^ 1 ) . 

This model can also use the minimizable criterion of the 
weighted trace, where 

"•i+i ' 

where W is a diagonal matrix with weights for the various 
state variable variances on the diagonal. 

2 ) Minimum-weighted trace-limited look points 

The first method is a thorough method designed to find 
the best look point in the total display setup. The only 
problem with this scheme is that it can consume large amounts 
of computer time since it may look at a large number of points 
before arriving at a minimum. This is especially true in a 
complex display set. Also, it does not imitate human behavior 
in that it may well choose look points between displays. 

This would be in order to get information from two or more 
displays at once. Human visual behavior tends to concentrate 
on one display at a time. 

With these ideas in mind, the algorithm was modified 
to limit the candidate look points to one point in each 
display, such as the center of each display as follows: 

Assume there are n displays and let 

long^, lat^ = longitudinal and latitudinal coordinates 

of the center of the display. 

£ 

Now calculate cr^^-|, f. = 1 , 2 , 3 . . ., n 
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with 


as before except that the associated look points will 
be longj^, and lat^. If 

+ l 1 for all 


then choose the look point associated with display j as 

c t 

the i+1 look point. 


This algorithm intuitively would seem more likely to 
generate scanning patterns more similar to human pilot scanning 
than the first algorithm. With this technique, the next look 
point should go to the display associated with the variable 
whose weighted variance is disproportionately larger than the 
other variables; otherwise, the look point would stay on a 
central display. 


3) Weighted mini-max with limited look points 

In this techni que; the previous algorithm was adapted to 
a different error criterion. In this case, the algorithm 
picks the maximum weighted diagonal element of the covariance 
matrix of the next state prediction ( 2 ^. ^1 | ^. W ) , then minimizes 
that val ue i n j; 


i+1 |i+l 


So that if 0 |^ is any diagonal element 


of 


^i+1 I i 


,th 


and W|^ is the k diagonal element of the weight 


matrix, W, then find j such that 


2 2 

Wj Oj 1 W|^ 0 |^ for all k 1, 2, 3 . . . , nv 

The algorithm now searches for the display look point that 

2 I 2 t 

minimizes the Oj in In other words, cr^_^^ = Oj 

These diagonal values are the variances of the state 
variables. So, if the weighted variance of a state variable 
is large in ^-j + ijj* then the look point for time step i + 1 
should be in a display that is associated with that variable. 


27 



This algorithm seems to more intuitively reflect the 
human pilot's behavior than the previous two algorithms. 

Here, it is presumed that the pilot only looks at a particular 
display when he feels his estimate of the variable or variables 
associated with that display are being estimated more inaccu- 
rately, in a weighted sense, than the other variables. 

For example, assume there are three state variables with 
three separate displays, one for each variable. Assume that 
at time step i 

{ 5.0 
3.2 
4.6 

and 

- r 

so that 

= 10.5 

‘"’^i + l ~ '^2 ^2 ~ 

crj^l = • W3 = 11.2. 

Therefore, the i + l^*" look point should be the display associated 
with the third variable. 



Final Model Formulation 

The final model uses the static display setup and evalu- 
ation with the dynamic Kalman Filter movement to create a 
simulation of a set of moving displays. Using this simulation 
with the look-point controller results in scan patterns similar 
to the scan of a human observer of a set of moving displays. 
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These patterns and the associated statistics can be used to 
evaluate a display set with respect to effective human use. 

The general formulation of the model can be seen in 
the flow chart in Figure 5A. At point A, all of the simu- 
lation setup has been decided upon, and the simulated time 
begins with some predetermined look point. At each time step, 
the model generates a new state vector and observation vector 
according to the Kalman Filter parameters and the present 
look point. Using these values, the model then derives the 
present Kalman Filter results and the predicted re suits. 

This information is used by the 1 ook-poi nt, control 1 er to 
determine the next look point. This procedure continues until 
the desired simulation time has elapsed. Fi gure 5B gi ves a 
flowchart of the Kalman Filter process. 

COMPUTER PROGRAM 

The flow chart in Fi gu re 5A gi ves a brief description 
of how this technique works. A more complete flow chart is 
shown in Figures. This flow chart more accurately describes 
how the computer program actually implements the method. Here, 
the program user first reads in the display setup; this 
includes the various size, weighting, locations, and function 
options. Next the dynamic process (Kalman Filter) options are 
read in. These options describe the type of flight conditions 
that will be simulated. Finally, the look-point controller 
options and weights are read in. Once the options and para- 
meters are determined the program begins the simulation for 
the required time period. Once the simulation is completed, 
the program looks fora new simulation if it is desired; 
if not, the computer run is completed. 

Display Setup 

Figure 7, Flow Chart A, shows how and when the display 
parameters and option are established. Up to seven displays 
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can be specified in the program. Each display is separately 
described in terms of location, size, and display segmentation. 
Also, a variety of display types can be specified. These 
include, but are not limited to, horizontal or vertical linear 
display, circular dial display, eight ball or artificial horizon 
display, T.V. camera or artificial runway display, and glide- 
slope indicator. Display types that are not included can be 
incorporated into the program with a user-provided subroutine. 
The display parameters can specify the state variables to 
be displayed, proportional movement, and various other values. 

The final display option, which is treated separately, 
is the segment weights. These weights usually range from 
zero to one, cannot be negative, and indicate the amount of 
relative information in each segment under initial simulation 
conditions. These weights can be reset every time step, after 
a read-in look point of = 1000, or set and left at all ones. 
The display setup and weighting determine the values of the 
influence matrix, T , which relate display movement to 
state vector changes. 

Kalman Filter Options and Parameters 

Figure 8, Flow Chart B, demonstrates the selection of 
the read-in parameters and options for the Kalman Filter 
dynamic display portion of the computer program. The first 
values read in concerning the Kalman Filter are the option 
for reading the A, B, and D matrices (ABDOPT) and the option 
for reading or calculating the control vector £ (CNTRLOP). 

The ABDOPT value allows for reading the A, B, and D matrices 
initially only, or reading in new matrices at each time step. 

The CNTRLOP value determines if the control vector is only 
read in initially, read in each time step, or calculated at 
each time step in a s ubroutine cal led UCALC. 

Next to be read is the number of time steps (the size of 
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each time step is determined by the A, B, and D matrices). 

Tlie initial state vector valiies, = £(>1^). are read in 
next, after which follows the system noise (state vector 
standard deviations) parameters. These noise values and the 
D matrix determine the amount of random change that occurs 
in the state vector from one time step to the next. The last 
values that concern the Kalman Filter are the A, B, and D 
matrices and the control vector. These are read in or calcu- 
lated according to the ABDOPT and CNTRLOP values. 

As stated ear 1 i e r , the Kalman Filter calculates + 
such that 


ii., = i, + u, 


“i 


where 

cov (y. ) = r = diagonal matrix with on the diagonal 

'^3 

and 

0 ^ = standard deviation of system noise or turbulence 

of state variable j. 


So that matrix A determines what effect the present state, , 
has in one time step on the next state, + The B matrix 
determines how the present control vector, , effects the state 
vector in one time step. Finally, the D matrix determines 
the effect of the system noise, in one time step on the state 
vector, 2i^- + i • 


Look-Point Controller Options and Parameters 

There are five look-point controller options. The value 
LKOPT determines which of several algorithms are used for 
finding the look point for the next time step. The five look- 
point controller options are as follows: 
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1. Use the last read-in look point, no calculations 
involved. The program does not operate the look-point controller 
subroutine until a look point has been read in with a negative 
degradation factor. With option 1, this last look point is used 
as a constant for the remainder of the simulation run. 

2. Calculate center of weighted segments. This option 
should be used when only one display or possibly two adjacent 
displays are being simulated. Under this option the look \ 
point control calculates the location of the center of the 
weighted segments and chooses that location as the next look 
point. Previous experiences with the static technique indicated 
that this is an approximate optimum look point for one display. 

3. Local minimum weighted trace ( Tr[i | ^ 1 W] ) . Using 

the numerical iterative technique described earlier this 
option finds a look point that is a local minimum of the sum 
of weighted diagonal values of the covari ance matrix of the next 
look point, 

4. Minimum of all displays of the weighted trace of 

2^.j + 1 |-j + l ( + 1 I i + 1 ^^^ ^ this option the weighted trace 

of i^-^i is calculated for one look point in each display. 

The look point with the smallest value is selected. 

5. Weighted mini-max. Minimize, over all displays, variance 

of variable with maximum predicted weighted variance. Using 
this option, the controller finds the largest diagonal element 
of the weighted predicted covariance matrix ( + ] | -j W) . + 

is based on the present look point. The program then calculates 
the covariance matrix for a look point in each display. The 
look point is chosen which minimizes the diagonal value of 
^•j + l|-j+-| previously determined to be maximum for ^-j+ij-jW. 
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Program Output 


The program contains several output options along with a 
standard output at each time step. Figure 9 shows a flow chart 
of the printed output. The program will initially print the 
program title along with the various options and parameters that 
have been chosen. This may be followed by an optional printout 
of the influence matrix, T. This influence matrix printout will 
occur periodically, if chosen, throughout the simulation run. 

The influence matrix is recalculated only after a significant 
change in the state vector and will be printed when recalculated. 

The next printout to occur will be the weighted values of 
the segments for each display. This is only if and when the 
weights are read in. If the weights are all set to one, there 
will be no printout. The look point for the next or initial 
step is now printed. The location of this look point with 
respect to each display is given and the manner in which it was 
determined; that is, whether or not the look point was read in 
or calculated and how it was calculated is printed out. 

Following the look-point print is an optional printout of 
the display observation values. These values are the horizontal 
and vertical displacements (printed separately) of each segment 
of each display. These are the changes due to change in the 
state vector in the past time step (step i-1 to i). 

The final printout occurs with each time step (nonoptional). 
It includes the present time step, present estimation of the 
state vector change in last time step, the actual state vector 
values, the covariance matrix of the estimation, and the corres- 
ponding correlation matrix with standard deviations on the diag- 
onal. This same printout is generated for the predicted change 
from time i to time i+1. The A, B, and D matrices are printed 
at this time also, if they are being changed or initialized. 

The same is true of the print of the control vector, jj . 
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ANALYTICAL RUNS 


ILS Flight Situation .- The Instrument Landing Situation 
(ILS) is the most critical portion of flight control. Because 
of this, many ILS simulators are available along with data from 
experiments using the simulators; therefore, an ILS approach 
was decided upon as the first area of investigation using the 
dynamic display evaluation program. 

For simplicity's sake, several assumptions have been made 
which were deemed not to affect the situation under study; that 
is, the viewing of the active displays under ILS conditions. 

The assumptions are that the ai rcraf t is on course and is 
stable in roll and yaw. The sources of turbulence (system 
noise) are due to pitch, range to go (x^)» altitude (z^), x^, 
and z^. The aircraft is assumed to be perfectly controlled; 
in other words, any departure from the ideal flight path is 
corrected at the next time step. When in use, the command bars 
are considered as separate state variables. 

Description of Display Setup .- Figure 10 shows a mock-up 
of the various active displays. These are the eight ball, 
glide slope indicator, altimeter, vertical speed indicator, 
airspeed indicator, and the vertical and horizontal command 
bars. The response of the various displays to changes in the 
state variables is obvious, except for possibly the command 
bars and the glide slope indicator. In this case, when active, 
the command bars display the command state variables in a one- 
to-one fashion. The glide slope indicator (GSI) shows devi- 
ations from a 2.5° glide slope up to ±1.8°. This is determined 
by the range to go, x^, and altitude, z^ (see Appendix B, GSI 
response ) . 

Pilot Tasks--Automati c and Manual Approach .- Two tasks 
are being compared in this investigation. One is the automatic 
landing situation where the pilot's task is to monitor the 



instruments for possible malfunctions. In the automatic 
approach, the command bars are inactive. In the manual 
approach, the pilot controls the aircraft by using the control 
information provided by the command bars. 

Results of Computer Simulations 

In all of the computer simulations, the ILS approach 
starts at an altitude of 460 meters, and a distance out of 
10,770 meters. The aircraft automatically remains on course 
and on a glide slope of 2.5°, airspeed of 85 meters per second 
(165 knots) and a vertical speed of -3.7 meters per second. 

Fixed Look Points .- Since the computer algorithms for 
look-point calculation is dependent on the user selected 
weights, initial runs were taken where the look points were 
read in and kept on each display for three or more time steps. 
In a typical run, the variances of the estimation of the state 
values from the initial observation are high. As each display 
is scanned, the estimation variances of the state variable(s) 
associated with that display converge rapidly to some limit. 
This limit is controlled by the inherent system variance (noise 
or turbulence) in the particular variable. The convergence time 
is controlled by the accuracy with which the variable 
information is displayed. 

These convergence limits were used to get approximate 
values for the weights to be used in the calculation of look 
points in other runs. Figure 11 and Table 1 show typical data 
from this process. The values displayed here are the weighted 
standard deviations of the variables. The weights in this 
case were calculated so that all variances converged to approx- 
imately the same values. The variance of range (x) was the 
largest and was given a weight of one. The other variables 
were weighted such that their variances converged to the 
minimum variance of x, which was 45.9. For example, the weight 
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for a. is 300. That is because the smallest value of o„ at 

6 y 

time 22 was .154 minutes of arc. 

Once these variances have converged to some value, they 
will -either remain close to that value or start to increase. 
This depends on the acuity of the display associated with that 
variable with respect to the present look point. The size of 
the increase is associated with the system noise of that vari- 
able as compared to the present value of the variance of 
estimation. 

In the example shown in Figure 11 and Table 1, the first 
look point is the airspeed display. Correspondingly, the 
weighted values associated with x^, 89.6, is much lower initi- 
ally than other values, which are 909 up to 1,450. The x^ 
value drops to 47 in three steps. As the look point goes to 
the other displays which do not contain pitch information, 
the pitch value climbs slowly to 78 (time step 13). The rate of 
this climb depends upon the location of the look point at any 
given time; for example, from time 4 to 7 the look point is on 
the VSI. This is the furthest instrument from the airspeed 
indicator. During this time period increases at a rate of 
about 2.1 per time step. Likewise, at times 16 to 22 the look 
point is on the eight ball which is the closest instrument to 
the airspeed indicator. During this time, increases at 
about 1.3 per time step. Similar responses can be seen with 
the eight ball VSI and altimeter A somewhat 

different response is seen with the GSI -o^^. This is because 
the GSI is related to both x^ and z^. Thus, the GSI look point 
reduces both and °2r* when the altimeter look point 

is taken, continues to decrease. This is because of the 
high correlation between x^ and z^ when looking at the GSI. 

The altimeter look point reduces this correlation or confusion 
factor and thus reduces both 02 ^ and 

When using the look-point optimization, the look point is 
not read in, except initially; but it is determined as the 
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display which maximally reduces either the sum total weighted 
variances (weighted trace of the covariance matrix) or the 
predicted largest weighted variance. (Note: This prediction 

is based on keeping the present look point.) 

Table 2 shows an example of the weighted mini-max process. 
This table shows the next look point is the center of the 
display associated with the variable having the highest weighted 
variance at the present state. The only exception being at 
times 11 and 22. This is because the next look-point criterion 
is based on the prediction variance for the present look point. 
The table shows the present estimation variance. At step 10, 
o„ and a- have very close weighted values. The airspeed is 
chosen at step 11 because the o* prediction is larger. The 

Xr 

same is true at step 21 where 0 , a», and 0 ; have similar 

values. Here a predicted is larger than o- or a-. 

^r ^r ^r 

Variance Weight and System Noise .- The above results 

show that the model behaves generally in a manner similar 
to human behavior and follows a pattern that is intuitively 
reasonable. The optimized look-point procedure is dependent 
on the selection of weights and the determination of the 
system variation (noise). Here, the weights are considered 
to be constant over time; the same for the system variation 
parameters. This assumption is probably valid for short 
periods of time but certainly not for different flight regimes 
(such as takeoff, landing, in flight, approach, etc.) or 
stages of the same regime (in-flight turn, descent, final 
approach, etc.). Also, the look point selected by the human 
reflects his opinion of how the system noise is effecting his 
variable estimation. His opinion of this noise is probably 
much larger than the actual effect. For example, if the 
controller does not look at the airspeed indicator for some 
period of time, the variation of x estimation will grow, but 
his estimation of this growth is probably much larger than 
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reality. Thus, he feels he must glance at the airspeed indi- 
cator sooner than necessary to bring the x variance down to 
a reasonable level. 

A computer algorithm for determining the controller 
weights can be devised. But this algorithm must somewhere 
include some user determined parameters, such as allowable 
variance limits for each variable. Although this type of 
controller may logically be closer to the human thought process, 
it would still generate scan patterns dependent upon the input 
user parameters just as the present system is dependent on 
the input controller weights. The present configuration has 
the advantage of expediency and savings in computer time. 

Results of Comparing Automatic and Manual Approach 

With some of these ideas in mind, an attempt was made 
to run simulations comparing two real-life simulations. One 
is the automatic ILS approach where the pilot monitors the 
five previously discussed instruments (eight ball, glide 
slope indicator, altitude, vertical speed indicator, and 
airspeed indicator). The other is the manual ILS approach. 

The manual approach has the same instruments but also includes 
the horizontal and vertical command bars. In the real-life 
automatic situation, the pilot continually scans all five 
instruments. In the manual approach situation, the pilot tends 
to fixate on the command bars and occasionally glance at the 
other instruments. 

Automatic Approach .- Table 3 and Figuresl3 andl4 show the 
results of a six and one-half second simulation of the monitor 
situation. The time step is one eighth of a second. The system 
variation parameters are shown at the top of the table along 
with the weights used for the optimization routine. The 
weighted standard deviation values are shown in the table and 
plotted in the graph. 
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The graph of this data is shown in two parts. Figure 13 
has the first second (8 time steps) during which the weighted 
values begin converging in large steps to the lower limits. 
Figure 14 shows the remaining time (starting at the sixth time 
step). Here, the values intertwine, each one growing to a 
point that requires a look point at the correspondi ng display. 
The system seems to converge all variables to values between 30 
and 40. This occurs around the sixteenth time step or two 
seconds of scan time. The look points at each time step are 
shown at the top of the graph. The symbol on the look point 
graph indicates the variable being reduced in variance by that 
look point. 

For example, in Figure 14 at time 5 the largest value is 
for range (x symbol on graph). Thus, at time 6 the look point 
(top of graph) is on the GSI. At time 6 the highest value is 
pitch (symbol = 0) so that the look point at time 7 is the 
eight ball. Correspondingly, the values associated with the 
present look point show a marked decrease over the present time 
step. For example, at time 8 the look point is the altimeter; 
from time 7 to 8 the altitude (symbol = a) drops from 56 to 33. 

Figures 13 and 14 show only a portion of this run. The 
remaining time not shown demonstrates a similar pattern to 
times 16 through 26. Figure 15 shows the look points for the 
total 52 time steps. 

The transition frequencies for the different displays are 
shown in Table 4. Figure T6 shows the transition probabilities 
in a more graphic form. Note here that the glide slope has the 
highest look-point frequency. The glide slope was looked at 15 
time steps out of 52. The eight ball was next at 14, followed 
closely by the altimeter at 11. The reason for this can be 
seen in the table and graph of the weighted values. When 
not looking at the displays associated with pitch, range, or 
altitude, the weighted values grow at two to three units per 
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time step. This can be compared to the airspeed and altitude 
rate values which grow at 1 to 1.5 units per step. 

Manual Approach .- In this situation, the command bars were 
added to the display. The problem here is to select values for 
the pilot's perceived command bar system variances and the 
weights for look-point determination that reflect reality. If 
the variances and weights are too high, the predicted command 
bar weighted variance values jump to a level above the other 
variances even with continued fixation on that look point; this 
causes the look-point controller to ignore the other display 
for long periods of time. If these values are too low, then 
the command bars will be ignored or only glanced at occasionally. 
Several runs were made with different weights and system vari- 
ances. The results of the fixed run is shown in Tables 5 and 
6 and Figures 17, 18, and 19. Table 5 shows the various para- 
meters used, the look points for 25 time steps, and the 
weighted standard deviation values. Here, the location of the 
vertical and horizontal command bars and the eight ball is the 
same. The separation of their look points was determined by 
the variable whose weighted variance was being minimized. For 
example, at time 3, the pitch value is 187 so that the eight- 
ball look point is selected for step 4. (This reduces not only 
the pitch values but also the values associated with the 
command bars (120 to 21).) But at time 6 the cb^ has a larger 
predicted value indicating the look point at 7 was taken in 
order to decrease the cb^ value. The command bars have values 
very close to one another throughout the total run. The slight 
differences are due to random movement generated by the simu- 
lation. This locates the command bars slightly off the center 
of the eight-ball display thus slightly affecting the acuity 
of the command bars. 

The transition frequencies (Tables 6A and 6B ) are shown with the 


40 



command bars and eight ball separated and also with their 
combined frequency. Fi gure 20 shows the probabilities combined. 
The graphs of these data and the look points show how the values 
of all variables grow relatively slowly compared to the command 
bars' values. Because of this, the look point is always going 
to the command bars then going to various other displays from 
there . 


AREAS OF FURTHER INVESTIGATION 

The preliminary results from this program indicate much 
promise as a model of the human visual scanning process, 
but many questions remain unanswered. To be of use in evalu- 
ating displays for possible human use, the program must be able 
to imitate human behavior on present displays at some level 
of realism. 

Time Step .- The time step for the Kalman filter does not 
necessarily have to be constant. The filter processes infor- 
mation after every time step. Is it possible that the human 
operator processes visual information at different rates? 

It is possible that little or no processing occurs when the 
instrument is first perceived, but then the information 
process rate could increase the longer the display is observed. 
In other words, how long does one fixation take? If a fixation 
is repeated (keeps the same look point), is the time step 
the same, or does it take less time to get information once 
the look point is established? 

Variance Heights . - In the look- point selection algroithm, 
much emphasis is placed on the weights for the variables' 
variances. Are these weights really constant? Specifically, 
even during the same flight pattern do the weights change, say 
increasing the longer the pilot does not look at the displays 
associated with the variables? 
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System Noise (Variance) .- The relative size of the system 
noise of the state variables and the. relative weights are also 
important in the scanning process. In setting the system 
variation of the state variables, should realistic values 
be used or should they be values that reflect how the pilot 
perceives them? 

Display Modification .- The importance of comparing these 
various options of time step, system noise, and weights 
becomes obvious when comparing two or more display types with 
the same state variables. If the human pilot does have fixed 
weights and fixed system noise for the various variables, 
then these values should not change even under radically 
different displays. These weights are for the state variables, 
not for the displays. Any change of scan and accuracy of 
estimation should be due to the displays. 

One topic only mentioned in passing was the complexity of 
various look points or displays. One measure of this is the 
absolute size of the correlations between the state variables. 
Should this complexity be used not only as a secondary measure 
to compare display setups but also be used for finding optimum 
look points? 

Closed-Loop Controller .- In the present program the 
aircraft dynamics including the closed-loop control system 
are not simulated. A perfect controller is assumed; that is, 
the aircraft's state variables (no matter how large the 
variances in their estimation) are at each time step perturbed 
about their nominal value by some random variable with a 
fixed probability distribution. 

This is certainly in contrast to reality with manual 
control. Here, as the pilot's errors in the estimation 
of the state variables becomes larger, the deviations from 
the nominal flight path will increase. It would appear to 
be worthwhile to gain more insight into how much error in 



the state variable estimation a pilot can afford to make his 
landing acceptable. 
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Appendix A 

Derivation of Simplified Forms of the Gain Matrix 


This appendix show the derivation of simplified forms of the 
gain matrix and covariance matrix from the Kalman Filter process. 
These forms are for both the present time step and the prediction. 
We first derive the following lemma. 

Lemma: Let B and R be positive definite symmetric matrices and 
let H be any matrix (including rectangular). Let A be defined by 

A = 

Then 

A"^ = B'Uh'R"^H. 

Proof; Assume the above form for A"\ then 

AA"^ = [B-BH' (HBH' + R)"^HB][B"Uh'R"^H] 

= I-BH' (HBH'+R)'^H+BH'R"^H-BH’ (HBH'+R)"^HBH'R‘^H 
= I-BH'[(HBH'+R)"^H-R’^H+(HBH '+R)‘^HBH'R"^H] 

= I-BH'[(HBH' + R)"^-R~U(HBH' + R)"^HBH'R"^]H 
= I-BH'[(HBH'+R)'^ (I + HBH'R”b-R"^]H 
= I-BH'[(R+HBH')"^(R+HBH'R"^R)R"^-R"^]H 
= I-BH' [(R+HBH ' (R+HBH' )R"^ -R"^ ]H 
= I-BH'[IR“^-R"^]H 
= I. 


Now in the original Kalman Filter process 


1 


V 


and 


= [l-K^ T 


|i-l li-1 




NoH.since 2^i.j_1 and H. are symmetric positive definite we can 
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apply the lemma. This gives 


* ’■ i=?' r 


We can now write 


I " i=^ih-i " 

= T T ;=:' . i)-' * 

•-1 •-! -1 
T .E. T .E.I. , T .H. ( T..E.|. , T .H. + I) '] 

11 ll|l-l ll' ll|l-l 11 ' 

= E.|. T IeTV( T .E.,. 1 T !eT^ + I) + 

1 I 1 11 1 1 I 1-1 11 ' 

T .E.I. , T IeT^C T .Z.|. t T !h7^ + I)] 

1 1 1 1-1 1 1 1 1 1 1-1 11 

= E.|. T !=:^[(I+ T .E.|. T T !eT^( T .E.|. , T !eT^ 

l|l I 1 1 l|l-l 11 1 l|l-l 1 1 

+ I)'^] 



i"i ' 
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GLIDE SLOPE INDICATOR (GSI) RESPONSE 
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Information Flow for Dynamic System 
(Dotted Lines - Static System) 


























E)(AMPLE OF A SEGMENTED ARTIFICIAL HORIZON 
DISPLAY MOVING IN THREE TIME STEPS 


FIGURE 2 



ac (x ) 



SAMPLE ACUITY FUNCION 
FIGURE 3 . 
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1 


t^lxo.yo) 



T 1 me 
Ste 


“oii-i Vx,-., y, 


'yt-1 yyi-i 


1 

.25 

-1 .0 

.05 

-.05 

-1 .0 


2 

-.81 

-1 .0 

-.06 

-1 .01 

-1 .0 

.( 

3 

-1.91 

- 1.0 

-.1 

-1 .09 

O' 

HBH 



= X, t ux, + Yx,^ y,-+i ' yi ^ “yi * yyi 

iitl ‘ *tii * * “ill 

= = [:;J. X, = [:;J. cov(^,, = r = [7 

E(^.o) = (]). ^0 = ^ = (0 

KALMAN FILTER PROCESS EXAMPLE - STATE EQUATIONS . 

FIGURE 4A 



ii 

°i = ^ ^ ^i 

T^. = (I . 1 ) , C 0 V(C^ ) 


Time 
Step ^ 

0 2.55 

1 -.05 

2 -1.57 

3 -3.1 


.5 

-.25 

.25 

-.1 
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KALMAN FILTER PROCESS EXAMPLE - OBSERVATION EQUATIONS 

FIGURE 4B 
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DETAIL FLOWCHART - KALMAN FILTER 
FIGURE 5B 

























READ TITLE 


ND = NUMBER 
OF DISPLAYS 


TITLE 

='END' 


READ AND PRINT FOR THE ID— DISPLAY; 

LOCATION - Horizontal and Vertical 
Coordi nates 

SIZE - Maximum Horizontal and Vert- 
ical Angles from Display center 
SEGMENT SIZE - Vertical and Horizontal 
DISPLAY/STATE FUNCTION - Options and 

Parameters 

SEGMENT WEIGHT OPTIONS 


= ID + 1 


ID > ND 


READ REMAINING OPTIONS 
AND PARAMETERS 


FLOW CHART A 

DISPLAY OPTIONS AND PARAMETERS 


FIGURE 7 











FLOW CHART A (Continued) 


FIGURE 7 (Continued) 
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< 3 > 



YES 



READ AND PRINT: 

ABDOPT AND CNTRLOP FOR A, B. D, AND u OPTIONS; 
lEND - NUMBER OF TIME STEPS'; 

INITIAL STATE - m = E (x ) ; 

STATE VARIABLE NOISE CSTD. DEV.). 


READ A, B, 
AND D 
MATRICES 


READ A.B,D 


EACH STEP 



YES 


READ A,B,D 
INITIALLY 






READ u 

INITIALLY 


YES 


©- 



CALCULATE u 
EACH STEP~ 


CALL 

UCALC 


READ 

EACH 


READ u 


d) 


FLOW CHART B 

KALMAN FILTER OPTIONS AND PARAMETERS 
FIGURE 8 
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I > TEND 



FLOW CHART B (Continued) 


FIGURE 8 (Continued) 

















I READ AND 
PRINT SEGMENT 
WEIGHTS 


PRINT OPTIONS AND OUTPUT (Conitnued) 


FIGURE 9 (Continued) 








GLIDE SLOPE 
INDICATOR 



DISPLAY SETUP 
FIGURE 10 







WEIGHTED STANDARD DEVIATIONS 





WEIGHTED STANDARD DEVIATIONS 




WEIGHTED STANDARD DEVIATIONS 



WEIGHTED STANDARD DEVIATIONS 
Automatic Approach — 0 - 1 Seconds 

FIGURE 13 
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AUTOMATIC APPROACH CONTROL 





AIRSPEED 

INDICATO 
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TRANSITION PROBABILITIES 





WEIGHTED STANDARD DEVIATIONS 


SYMBOL 

DISPLAY 

VARIABLE(S) 

D 

Ai rs peed 

^r 

O 

VS I 


A 

Al timeter 


☆ 

GSI 

x^(z^) 

0 

Ei ght-Ba 1 1 

e 

a 

Hori zontal 

CBh 

and Command 

V 

Vertical 

CBw 


TIME STEP (1/8 Second) 

WEIGHTED STANDARD DEVIATIONS 
Manual Control Approach —0^1 Seconds 
FIGURE 17 







WEIGHTED STANDARD DEVIATIONS 





LOOK-POINT PATTERN 





TABLE 1 


FIXED LOOK POINTS 

WEIGHTED STANDARD DEVIATIONS 
VARIABLES 




Weights — • 

^0 

300 

"x. 

1 

55 

"x, 

100 

320 

T i me** 
Step 


Look Point 






0 

5 

Airspeed 1 

,146 

1 ,450 

1,128 

89.6 

909 

1 

5 

II 

810 

1 ,020 

798 

63.8 

643 

2 

5 

II 

660 

827 

655 

52.9 

525 

3 

5 

II 

573 

714 

567 

47.0 

454 

4 

4 

VSI* 

519 

614 

451 

49.3 

75.5 

5 

4 

II 

480 

549 

388 

51 .5 

54.7 

6 

4 

II 

447 

501 

345 

53.6 

45.8 

7 

4 

II 

423 

463 

315 

55.6 

41.0 

8 

2 

GSI* 

265 

133 

271 

57.5 

43.8 

9 

2 

II 

209 

112 

243 

59.3 

46.4 

10 

2 

II 

179 

101 

223 

61 . 1 

49.0 

1 1 

2 

II 

159 

92.1 

207 

62.8 

51.2 

12 

3 

A 1 ti me ter 

159 

50.8 

81.4 

64.5 

53.4 

13 

3 

It 

159 

46.5 

58.9 

66.1 

55.7 

14 

3 

II 

158 

45.9 

50.7 

67.7 

57.6 

15 

3 

II 

158 

46.3 

47.1 

69.2 

59.2 

16 

1 

Eight Ball 

85.5 

47.1 

54.5 

70.7 

61 . 1 

17 

1 

II 

66.6 

47.9 

61 . 1 

72.0 

63.0 

18 

1 

II 

57.6 

48.6 

66.6 

73.4 

64.6 

19 

1 

II 

52.5 

49.3 

71 , 5 

74.6 

66.2 

20 

1 

II 

49.5 

50.0 

76.5 

75.9 

67.8 

21 

1 

II 

47.4 

50.7 

80.9 

77.1 

69.4 

22 

1 

II 

46.2 

51.3 

84.7 

78.3 

70.7 


*VSI--Vertical Speed Indicator; GSI--Glide Slope Indicator 

**Time Step--1/8 second 
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TABLE 2 


EXAMPLE OF WEIGHTED MINI-MAX 
LOOK POINT CONTROL 


T ime** 
Steo 

Look Point 

0^*300 

a * 

o_* 55 
^r 

* 1 00 
Xr 

04 *320 

0 

1 

Eight Ball 

102 

547 

836 • 

957 

688 

1 

5 

Ai rs peed 

104 

490 

671 

88.8 

547 

2 

3 

Altimeter 

100 

350 

71.5 

89.9 

394 

3 

4 

VSI* 

107 

336 

76.5 

90.9 

77.8 

4 

2 

GSI* 

104 

73.5 

80.3 

91.8 

78.7 

5 

1 

Eight Ball 

73.8 

73.4 

84.2 

92.6 

79.7 

6 

5 

Ai rspeed 

76.5 

74.0 

88.6 

66.9 

81.0 

7 

3 

Al ti me ter 

7-8.9 

71.8 

67.7 

68.5 

81.6 

8 

4 

VSI 

81 .6 

72.4 

73.2 

70.0 

58.6 

9 

1 

Eight Ball 

65.7 

72.2 

77.6 

71.4 

60.5 

10 

3 

Al ti meter 

68.7 

71.7 

61.6 

72.9 

62.1 

1 1 

5 

Ai rs peed 

71.7 

72.3 

67.7 

57.4 

64 

12 

1 

Eiglit Ball 

60.3 

71.9 

72.6 

59.2 

65.6 

13 

3 

Al ti meter 

63.6 

71.9 

54 

61 .0 

66.9 

14 

2 

GSI 

6 5.4 

51.7 

59.4 

62.7 

68.2 

15 

4 

VSI 

68.4 

52.6 

64.9 

64.4 

49.0 

16 

1 

Eight Ball 

58.5 

53.2 

70.4 

66.0 

51.5 

17 

3 

Al ti meter 

62.1 

53.2 

52.1 

67.6 

53.4 

18 

5 

Ai rspeed 

65.1 

54.1 

58.9 

55.3 

55.7 

19 

1 

Eight Ball 

57.6 

54.6 

64.9 

57.2 

57.9 

20 

3 

Al ti meter 

61.2 

55.1 

53.2 

59.1 

59.5 

21 

1 

Eight Ball 

54.3 

55.6 

60.0 

60.8 

61.4 

22 

3 

Altimeter 

58.2 

56.2 

53.3 

62.6 

63.0 


*GSI--Glide Slope Indicator; VSI--Vertical Speed Indicator 

**Time Step--l /8 second 
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TABLE 5 

WEIGHTED STANDARD DEVIATIONS - MANUAL CONTROL APPROACH 


Variables 

0 

Xr 

Zr 

Xr 

1 

CBH* 

CBV* 

Rate of System 

.023° 

26.(ntrs 

. 1.2 3 

im 

1 

BBI 




/sec. 

/sec . 

iiimsizai 

IlilFJinSI 

1 

liTRR3S| 



Wei ghts--W 

1 80 

1 

[MB 

■■IB 

fmm 

mm 

29 

Time** Look Point 
Step 

a 


I^B 





0 3--Alt.* 

687 

751 

44.6 

649 

354 

373 

373 

1 2--GSI* 

202 

79.1 

46.7 

410 

256 

120 

120 

2 5--Arspd* 

193 

79.6 

49.5 

51 

234 

120.2 

120.0 

3 4--VSI* 

187 

79.9 

50.6 

51.5 


43 

120.7 

120.5 

4 1 --8 Bal 1 

57.5 

79.5 

52.5 

61 .7 


43.8 


21.9 

21.3 

5 2--GSI 

56.3 

61.6 

53.4 

52.0 


44.6 


42.4 

42.6 

6 2--GSI 

55.4 

54.8 

54.3 

52.3 


45.4 


52.9 

52.9 

7 6--CBH* 

41 .6 

55.4 

55.8 

52.5 


46.2 


20.4 

19.9 

8 3--AU. 

43.4 

49.0 

32.9 

' 52.8 


46.7 


44.6 

44.4 

9 6--CBH 

36.7 

49.7 

36 

53 


47.5 


20.9 

20.2 

10 5--Arspd. 

38.7 

50.7 

39 

34 


48.4 


44.8 

44.5 

11 6--CBH 

34.0 

51.3 

41 .7 

34.7 


49 


20.5 

20.0 

12 2--GSI 

35.6 

45.2 

42.6 

35.5 


49.6 


42.3 

42.1 

13 6-- " 

32.0 

46.1 

45 

36.1 


50.2 


19.9 

19.9 

14 4--VSI 

34.4 

47.1 

47.1 

36.9 


35 


44.4 

44.4 

15 6-- " 

31 .5 

47.9 

49.2 

37.5 


36.4 


20.5 

20.1 

16 3--AU. 

33.8 

47.0 

31.2 

38.2 


37.4 


44.6 

44.5 

17 6-- " 

31 . 3 

47.8 

34.5 

38.8 


38.6 


22.8 

20.4 

18 2--GSI 

33.2 

41.8 

36.3 

39.4 


39.6 


43.1 

42.3 

19 6-- " 

30.7 

42.8 

39.3 

39.5 


40.6 


20.0 

20.2 

20 7--CBV* 

29.2 

43.8 

41.7 

40.5 


41 .6 


18.8 

18.9 

21 2-- " 

31.2 

40.4 

42.45 

41.1 


42.4 


41 .7 

41.7 

22 6-- " 

29.5 

41.5 

44.7 

41.6 


43.4 


19.8 

19.6 

23 3-- " 

31 . 9 

41.0 

32.7 

42.2 


44. 


44.3 

44.2 

24 6-- " 

29.9 

42.1 

35.7 

42.7 


45 


21 .5 

21 .0 

25 4-- " 

32.4 

43.2 

38.6 

43.2 


34.5 


45.1 

44.9 

26 6-- " 

30.4 

44.2 

41.4 

43.7 


35.8 


19.6 

20.4 


*Alt. — Altimeter; GSI — Glide Slope Indicator; Arspd — Air- 
speed; VSI — Vertical Speed Indicator; CBH — Command Bar 
Horizontal; CBV — Command Bar Vertical. 

**Time Step — 1/8 second 
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TABLE 6A 


TRANSITION MARIX — Manual Approach 
Eight-Ball and Command Bars Separated 


DISPLAY 

NAME FROiir''^^ 

1 


1 

mn 

H 


5 

TOTAL 

"TO" 

XSITS 

Eight- Ball 1 

El 


ID 

1 

0 

0 

1 

2 

Horizontal g 

■9 


n 

6 

5 

3 

1 

17 27 

Vertical 7 

El 


m 

1 

3 

1 

1 

8 

Glide 

Slope 2 

Indi cator 

1 

0 

5 

3 

1 

0 

0 

1 

10 

Altimeter 3 

0 

B 

3 

1 

0 

0 

0 

8 

Verti cal 

Speed 4 

Indi cator 

1 

B 

0 

0 

0 

0 

0 

5 

Airspeed c 

Indi cator 

0 

1 

1 

1 

0 

0 

1 

0 

3 

TOTAL "FROM" 
TRANSITIONS 

1 

1 7 
26 

8 

10 

8 

5 

4 



T 


TABLE 6B 
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